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^ : 1 Quadratic Stochastic Operator 

-)— » 
a. 

Let 

5™-i = {x = (xi, . . . , x„) e i?'" : X, > 0, 5^ X, = 1} 

psj I is the (m— 1) -dimensional canonical simplex in K^. The transformation V : S**"^^ ^ ^m-i 

is called a quadratic stochastic operator(q.s.o.) if 
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where 



'O ! a)pij,k > 0; &)Pij,fc = Pji,k] and c) 2^Pij,fc = 1 

for arbitrary i,j,k = I,--- ,m. Quadratic stochastic operator was first introduced in 
[Ij.Such operator frequently arises in many models of mathematical genetics [1-3]. Consider 
a biological population, that is a community of organisms closed with respect to repro- 
duction. Assume that each individual in this population belongs to precisely one species 
I,--- , m. The scale of species is such that the species of the parents i and j unam- 
biguously determines the probability of every species k for the first generation of direct 
descendants. Denote this probability,that is to be called the heredity coefficient, by Pij^k- 
It is then obvious that pij^k > for all i,j, k and that 

m 

^Pij,k = liij,k= I,--- ,m). 
fc=i 



Assume that the population is so large that frequency fluctuations can be neglected. Then 
the state of the population can be described by the tuple {xi,X2,--- ,Xm) of species 
probabilities, that is Xk is the fraction of the species k in the total population. In the 
case of panmixia (random interbreeding) the parent pairs i and j arise for a flxed state 
X = (xi, X2, ■ ■ ■ , Xm) with probability ojjXj. Hence the total probability of the species k in 
the flrst generation of direct descendants is deflned by q.s.o. (1). 

2 Markov Stochastic Operator 

In the case of panmixia (random interbreeding) the parent pairs i and j arise for a flxed 
state X = (xi, X2, ■ ■ ■ ) ^m) with probabihty XiXj. In this case we call corresponding trans- 
formation (1) 

m 

V : (yx)fe = ^ Pij,kXiXj, {k = !,■■■ , m) 

a Bernoulli q.s.o. 

Let n = {qij)^j^-^ be a stochastic matrix and x = (zi, X2, ■ ■ ■ , Xm) be a flxed state of 
population. If parents pairs i and j arise with probability XiQij we call such interbreeding 
U-panmixia or U-random interbreeding. Under Il-panmixia the total probability of the 
species k in the flrst generation of direct descendants is deflned as 

m 

Vn : (Viix)fc = ^ Pij,kqijXi {k = 1,- ■ ■ ,m). (2) 

We call a transformation (2) Vn : S"^~^ -^ S"™"^ a Markov quadratic stochastic operator 
of heredity. 

Under Il-panmixia the total probability of the species k in the {n + l)th generation of 
direct descendants is deflned as 

m 
^(ra+1) _ [Trnf^w _ \ ^ (n,n+l) (n,n+l) (n) 



(^n(x)).= $:i> C"^'^^^^ (^ 



X}. ' = (\/nlx))fc= > ph'i, 'q:/ 'x\' (/c = i,---,m) 



where n = 0, 1, 2, ■ ■ ■ , and x*-"^ = x. 

Here we have two type of nonhomogeneity :nonhomogeneity with respect to stochastic 
cubic matrices p("'"+i) =|| p^."^ || and nonhomogeneity with respect to stochastic 

matrices of random interbreeding H*^"'""''-'^) =|| g^-"'" \"\=\ • 

j£-Q(n,n+i) _|| ^^i™."- 117^-=;^ is deflned as g^-"'" = x"" then Markov quadratic stochas- 
tic operator of heredity(2) is reduced to Bernoulli q.s.o. (1). 

3 Non-homogeneous Markov Chains 

Let SM^ be a set of stochastic matrices H = (%)™=i- Given cubic matrix P =|| p^^^^ || 
we can write in the following form P = (Pi | P2 | ■ ■ ■ | Pm) where a stochastic matrix Pi 



has following form for any i 
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( Pil,l Pil,2 
Pi2,l Pi2,2 



Pil,m 
Pi2,m 



\ Pim,l Pim,2 ' ' ' Pim,m I 
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Q2m 



\ Qml Qm2 ' ' ' Hm,rn I 

be a stochastic matrix of random interbreeding that belong to S'Mm- Assume q^ = {qki-, qk2, 
It is evident q^. G S"™"^ for arbitrary k. For given cubic matrix P let us define an 
operator P acting on SM„i. 

I qi^i \ 

q2^2 



np 



(3) 



Here q^Pfc ^ 5"™^^ is the result of action operator P^ to vector q^^,. Evidently an operator 
P transform SM^ into itself. Thus for arbitrary x = (xi, X2, ■ ■ ■ , Xm) 
stochastic operator of heredity (2) has following form: 
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Vnx = x(nP) 



(4) 



According (3) HP is a stochastic matrix,so that the trajectory of a Markov stochastic 
operator of heredity is defined as a trajectory of nonhomogeneous Markov chain. Thus the 
study of the asymptotic behavior of Markov stochastic operator of heredity correspond to 
study of asymptotic behavior of a non-homogeneous Markov chain (5(1), Q{2), ■ ■ ■ , where 
Q{k) is one -step transition matrix with time step k. Note that 

jjik,k+l) p{k,k+l) 



Q{k) 



(5) 



Remark 1 For Bernoulli q.s.o. one-step transition matrix Q{k) with time step k is defined 
by initial distribution x*^*^) = x. Thus for any fixed x'^'^^ = x we have one-step transition 
matrix Q{k){x.) . 
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4 Ergodic Theorem 

We will say that the ergodic theorem holds for transformation Vn : 5*"*^^ 
each initial point x G S"^~^ the limit 

fc-i 



^m-i if fQ^ 
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exists. 

On the basis of numerical calculations Ulam conjectured [5] that the ergodic theorem 
holds for any Bernoulli q.s.o.. In 1977 Zakharevich [5] showed that this conjecture is false 
in general. He proved that the ergodic theorem does not hold for q.s.o. V , which is 
defined on the simplex S'^ by the formula 

V : {x, y, z) -^ {x^ + 2xy, y^ + 2yz, z^ + 2xz) (6) 

5 Ergodic non-homogeneous Markov Chains 

Given a non-homogeneous Markov chain ((5(1), <5(2), ■ ■ ■\ define 

g^^^ = g(2 + i)g(2 + 2)---Q(j). 

The Markov chain is said to be weak ergodic if for any given i > 0,as j — > cxd, each 
column of Q^'^ gets to be a constant column. 

(Though the constant may change with j.) Unlike in the homogeneous case, generally 
one should not expect that limj^oo Q^''' exists. 

Hajnal [7]introduced the powerful concept-scrambling matrix. 

Definition 1 (Scrambling). Let Q be the one-step transition matrix of a given Markov 
chain. Q is said to be a scrambling matrix if for any two distinct states i and j , there 
always exists a state k, such that both one-step transitions are possible:? -^ k, and j -^ k; 
or equivalently, qik and qjk are both positive. In another word, for each pair of rows in Q, 
there is a column such that the intersection are both positive. 

Let E be a set of stochastic matrices. A S-Markov chain is one whose transition 
matrices are all taken from S. 

Jianhong Shen[6] proved following statement. 

Proposition 1 Let S be a compact set of scrambling stochastic matrices. Then any 
E-Markov chain is weak ergodic. 

6 Zakharevich's example 

Let us consider Bernoulli q.s.o. 

V : {x,y, z) -^ [x +2xy,y +2yz,z +2xz). 
Here corresponding cubic matrix has following form P = {Pi \ P2 \ P3) 
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Then for any fixed x*^°^ = {x, y, z) one-step transition matrix Q{k){yL) has following form 

/ x^^^ + ?/('=) z^^^ 

Q(A;)(x) = x(^) y(fe) + 2(fe) 

\ i/(^') x('=) + z(^') 

where {x^^+^\y^^+^\z^^+^^) = V{x^^\y^^\ z^''^) for fc = 0, 1, ■ ■ ■ 

It is evidently that for any k and any (x, y, z) & S"^ a stochastic matrix Q{k){'x) is the 
scrambling matrix. 

Using a geometric approach to ergodic non-homogeneous Markov chains developed by 
Jianhong Shen we can prove the following proposition. 

Proposition 2 The set of all stochastic matrices {Q{k){x.) : x G S'^, A; = 1, 2, ■ ■ ■ } is 
a compact set. 

Corollary Considered by Zakharevich Bernoulli quadratic stochastic operator gener- 
ate non-homogeneous weak ergodic Markov chains. 

Proof follows from Proposition 1. 

Conclusion For any x G S*^ corresponding non-homogeneous Markov chain {Q(A;)(x) : 
k = 1, 2, ■ ■ ■ } is weak ergodic. 

Thus the continual family of weak ergodic non- homogeneous Markov chains is con- 
structed. 
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